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(54) Traffic shaper for network nodes and method thereof 



(57) The traffic shaping system according to the 
principles of the present invention increases the con- 
nection-carrying capacity of a network node by shaping 
the data cells to increase the admissible number of con- 
nections. In accordance with certain embodiments of 
the present invention, the traffic shaping system uses a 
data buffer at the ingress of the network node to selec- 
tively buffer classes of data cells. As such, the traffic 
shaping system exploits differences in delay tolerances 
between traffic classes to shape the less delay sensitive 
traffic classes to reduce the effective bandwidth of a 



connection of the particular traffic class and thereby in- 
crease the nodal connection-carrying capacity. Certain 
embodiments of the traffic shaping system operate with- 
in a framework to provide parameters for the traffic 
shaping system which increase the connection-carrying 
capacity for the node white meeting quality of service 
requirements for the data cells. In accordance with cer- 
tain embodiments, an integrated regulator and shaper 
is provided which concurrently regulates and shapes the 
traffic cells to increase the nodal connection-carrying 
capacity. 
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Description 

BACKGROUND OF THE INVENTION 

5 1. Field of The Invention 

This invention relates to network communication and, more particularly, to traffic shaping at network nodes (or 
increasing the nodal connection-carrying capacity. 

10 2. Description of Belated Art 

Networks are a principle way of exchanging or transferring information, such as signals representing voice, audio, 
text or video among communication devices. Such communication devices include devices for sending and/or receiving 
information, such as computer terminals, multimedia workstations, facsimile machines, printers, servers and tele- 
's phones The exchange or transfer of information is referred to as a call or connection. Information transmitted on the 
network can be of many different forms but is often formatted into fixed-length packets or cells. 

A network typically includes switching nodes having ports coupled by links to ports of other switching nodes and 
to the communications devices. Each link is uni- or bi-directional and is characterized by a bandwidth or link capacity. 
Information to be exchanged is often conveyed over a path comprising a set of nodes and links connecting the com- 
20 mumcation devices. The path can be regarded as a virtual circuit (VC) whereby one communication device specifies 
the mlended destination for the information, and the network delivers the information as though a dedicated circuit 
connected the two communication devices. Cells in transit between communication devices may temporarily be stored 
in buffers at nodes along the path of the virtual circuit pending sufficient available bandwidth on subsequent links along 
the path. 

25 Networks, such as broadband ISDN (BISDN) employing asynchronous transfer mode (ATM) packet switching, are 

increasingly being used for the reliable, high-speed transmission of information. This increased use has brought major 
changes in network architecture and infrastructure design as well as in network operations and/or in the classes of 
services offered over the network. Classes of services offered over a network can include, for example, video-on- 
demand and video teleconferencing. Moreover, particular classes of services, such as video teleconferencing, are 

30 relatively sensitive to routing delays and receive higher priorities than other service classes, such as video-on-demand, 
which are relatively delay insensitive. 

To obtain high revenues from a network, it is advantageous for network managers to operate the network at a 
relatively high call capacity, i.e. establishing and maintaining a large number of simultaneous VC's. The issue ot con- 
gestion control is intertwined with the notion of the capacity of the network measured in users for given quality of 

35 service, and the administration of admission control in real-time, where the goal is to admit users up to capacity. The 
statistical nature of a significant part of the traffic, its burstiness and variability, and the stringency of the quality of 
service requirements combined pose challenges. An essential prerequisite in dealing with these challenges is the 
regulation of traffic at network edges. 

Buffer memories are typically employed in the nodes to increase the number of VC's carried by the node by buffering 

io transmission of data cells that are relatively delay insensitive while buffering to a lesser extent transmission of those 
data cells that arc relatively delay sensitive. Such buffer memories, which can be relatively expensive, effectively op- 
erate as respective queues in the node for the data cells that are to be conveyed through the respective ports. 

Therefore, a system is required to enhance the connection-carrying capacity for the network nodes in an efficient 
and cost-effective manner. 

45 

SUMMARY OF THE INVENTION 

The traffic shaping system according to the principles of the present invention increases the connection-carrying 
capacity of a network node by shaping the data cells to increase the admissible number of connections. In accordance 

so with certain embodiments of the present invention, the traffic shaping system uses a data buffer at the ingress of the 
network node to selectively buffer classes of data cells. As such, the traffic shaping system exploits differences in delay 
tolerances between traffic classes to shape the less delay sensitive traffic classes to reduce the effective bandwidth 
of a connection of the particular traffic class and thereby increase the nodal connection-carrying capacity. Certain 
embodiments of the traffic shaping system operate within a framework to provide parameters for the traffic shaping 

ss system wh ich increase the connection-carrying capacity lor the node while meeting quality of service requirements for 
the traffic cells. In accordance with certain embodiments, an integrated regulator and shaper is provided which con- 
currently regulates and shapes the traffic cells to increase the nodal connection-carrying capacity. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Other aspects and advantages of the present invention may become apparent upon reading the following detailed 
description and upon reference to the drawings in which: 

FIG. 1 shows a packet/cell switch network in which the traffic shaping system according to the principles of the 
present invention can be used; 

FIG. 2 is a block diagram showing how certain embodiments of the traffic shaping system can be used in a network 
node to exploit differences in delay tolerances between traffic classes; 
FIG. 3 shows a traffic shaping system according to the principles of the present invention; 
FIG. 4 shows graphs relating lothe data buffer content in the traffic shaper system for different cases; 
FIG. 5 is a graph showing conditions that result in lossless shaping; 
FIG. 6 shows a block diagram of a traffic shaper system coupled to a single source; 
FIG. 7 are graphs showing the buffer content during busy operations; 

FIG. 8 is a graph showing effective bandwidth versus the size of the data buffer for a traffic shaping system ac- 
cording to the principles of the present invention; 

FIG. 9 is a graph showing effective bandwidth versus the size of the data bufler for different operating parameters 
for a traffic shaping system according to the principles of the present invention; 

FIG. 10 is a graph showing the admissible region for the multiplexing of a real-time source class and a non-real- 
time source class showing the effects of shaping the non-real-time sources; 

FIG. 11 is a graph showing the admissble region for the multiplexing of two source classes showing the effect of 
shaping the two classes; 

FIG. 1 2 shows an integrated regulator and shaper according to certain principles of the present invention; and 
FIG. 13 shows an alternative embodiment for an integrated regulator and shaper according to certain principles 
of the present invention. 

DETAILED DESCRIPTION 

Illustrative embodiments of the traffic shaping system according to the principles of the present invention are de- 
30 scribed below which increase the capacity of a network node by shaping data cells at the point of ingress into Ihe 
network or subnetwork. The traffic shaping system includes a method of selecting shaping parameters for the traffic 
shaping system to enhance the capacity of the node, which is measured in terms of carried connections. The traffic 
shaping system can be used in various different nodes and network configurations. The traffic shaping system, however, 
is being described for use in packet/cell switch network, including ATM and Internet Protocol (IP). 
ss FIG. 1 illustrates a packet/cell switch network 1 0 in which the traffic shaping system can be practiced. Network 1 0 

comprises communication links 12 coupling particular nodes 14 It is possible for the number of links 12 connected to 
a node 1 4 to be on the order of 51 2 or grealer. Each link 1 2 possesses a respective capacity of data packets that can 
be conveyed over the link per unit of time which is typically referred to as the link's bandwidth. Exemplary links having 
bandwidths of approximately 622 MB/sec have been used in certain BISDN networks. 
40 Packets or cells are units of data that are addressed with routing information. It is possible for the packets to be 

of fixed or variable length. Exemplary packets include ATM cells having a fixed length of 53 bytes. Additionally, packets 
in a higher protocol layer may have a longer length and are typically referred to as messages which can be subdivided 
to generate a plurality of cells for ATM switching. 

It is possible for one or more of the nodes to be located within a particular network switch, such as ATM data 
is switches commercially available from Lucent Technologies Inc., Murray Hill, N.J., including Lucent's GlobeView 2000 
switches. Particular nodes are coupled to access regulators 16 which are coupled to communication devices 18. The 
communication devices 18 are typically employed by service providers and users to enable the users to request and 
obtain services, such as video-on-demand or video conferencing. The access regulators 16 regulate the flow or rate 
of data packets from the communication devices 18 into the network 10 according to a function characterized by a set 
so of access regulator parameters. In this particular embodiment for example, the access regulators 16 are dual leaky 
bucket regulators (DLBR). However, other types of regulators can be used, including leaky buffer regulators, buffered 
leaky bucket regulators or cascaded leaky bucket regulators. 

When a communication device 18 wishes to transmit information to another communication device 1 8 via network 
1 0, a virtual circuit (VC) is requested. A VC is a path comprising a set of nodes and links. Each node 1 4 in this particular 
ss embodiment has associated with it at least one buffer of size B,, and each link has an associated bandwidth capacity 
C k . Ftouting the requested VC on the path will require network resources, e.g. buffer space in the nodes along the path 
and bandwidth in the links along the path. Moreover, before the requested VC can be routed, the network resources 
that are required must be determined so that a path can be selected which selected path has sufficient resources to 
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accommodate the VC. In other words, if communications device 18 has a certain buffer requirement in the nodes and 
a certain bandwidth requirement in the links, the requested VC should be routed only on those paths comprising notes 
and links with sufficient resources to meet the certain requirements. A. Elwalid, D. Mitra and R. H. Wentworth, "A New 
Approach for Allocating Buffers and Bandwidth to Heterogeneous, Regulated Traffic in an ATM Node,' I.E.E.E. J. 
Selected Areas in Communications, Vol. 1 3 , No. 6, August 1 995 and U.S. Patent application Ser. No. 08/506, 1 60 filed 
July 24, 1 995 to Elwalid et al., herein incorporated by reference, describe admission control and routing by determining 
required network resources. 

Information provided to the network 10, such as data, text, voice, video, etc., can be characterized by a traffic 
envelope, which bounds the cumulative traffic provided over multiple time scales or a bandwidth buffer curve. In the 
basic case, the traffic envelope is characterized by a set of parameters, including the long term average transmission 
rate r, peak rate P and maximum burst tolerance &y. The value of each information parameter in the set of information 
parameters is based on a particular quality or class of service, for example, contracting terms with the network provider 
for a maximum cell loss rate or delay time and for appropriate access regulator parameters which can be for instance, 
the rate at which data packets flow into the network 10. It is also possible for the particular grade of service to be based 
on priority levels of the data packets. 

The traffic shaping system according to the principles of the present invention can exploit the differences in delay 
tolerances between more time-sensitive traffic classes and less time-sensitive traffic classes, such as real time and 
non-real time, to shape and smooth the less delay sensitive traffic and increase the capacity of the network node 1 4 
by increasing the number of admissible connections. FIG. 2 shows a basic configuration of a network node 14 using 
the traffic shaping system at the ingress to a node to exploit the differences in delay tolerances between two different 
traffic classes to increase nodal capacity K, sources, which can be heterogeneous, provide data packets conforming 
to the parameters of the access regulators 16, which can also be heterogeneous. 

In this particular embodiment, the K 1 regulated sources are more time delay sensitive and have a maximum delay 
tolerance D. In this particular embodiment, the K, regulated sources feed directly into a FIFO statistical multiplexer 20 
with a buffer 22 of size B and an output port 24 or trunk of transmission bandwidth C. As such, the delay requirements 
for the K, regulated sources are satisfied ifB/C <= D. The K 2 regulated sources, which can be heterogeneous, are less 
delay sensitive and have a delay tolerance of D+D s (D s > 0). A shaper 28 can use the extra permissible delay to shape 
the data traffic. By shaping the data traffic for the less delay sensitive traffic, the admissible number of nodal connections 
increases, thereby increasing the capacity of the network node 1 4. 

FIG. 3 shows a particular embodiment of a traffic shaping system according to certain principles of the present 
invention. In this particular embodiment, the regulator 16 is a dual leaky bucket regulator (DLBR)16. In other embod- 
iments, the regulator 16 consists of other regulators or multiple cascaded leaky bucket regulators which constrain the 
traffic to fit a certain profile. For example, the regulator 16, instead ol being a dual leaky bucket regulator 1 6 can be a 
triple leaky bucket regulator, a quadruple leaky bucket regulator or, more generally, a multiple leaky bucket regulator. 

A data packet or cell arrives at the input of the DLBR 16. If a token is available both in a token buffer 30 and on a 
P line 32, join circuitry 34 permits the data packet to be output from the DLBR 16. The join circuitry 34 could be 
implemented using conventional logic and switch components as would be understood by one of ordinary skill in the 
art with the benefit of this disclosure. In this particular embodiment, the token buffer 30 can be implemented as a 
counter which is clocked at rate r as provided by processing circuitry 36 of the network node 14. The counter is incre- 
mented at the rate r and decremented when a token is usedto output a data packet from the DLBR 1 6. In this particular 
embodiment, the P lino 32 includes a P lino token buffer 38 which is capable of holding one token. Tokens arriving to 
the token buffer 38 when there is a token in store are lost. The P line token buffer 38 can also be implemented by a 
counter which is incremented at the rate P and decremented when the token is used to output the data packet from 
the DLBR 16. 

The token buffer 30 is capable of holding Bj tokens. Tokens are supplied to the token buffer 30 at rate r, and a 
token is used when a data packet is output from the DLBR 16. Tokens arriving at the token buffer 30 when the token 
buffer is full are lost (overflow). In this particular embodiment, the P line token buffer 38 receives tokens at the peak 
rate R and the P line token buffer 38 is capable of holding a single token which is used when a data packet is output 
from the DLBR 1 6. In general, since P > r, the output rate of the data packets from the DLBR 16 is bound by the rate 
r. However, during data bursts when the token buffer 30 has tokens available for example, the data packets are output 
from the DLBR 16 at the peak rate P. Thus, the DLBR 16 can be characterized by three parameters: r is the mean 
sustainable rate or token rate which bounds the long-term average rate of the regulated traffic; B T , is the burst tolerance 
or the token buffer size which bounds the burst size; and P is the peak rate, which bounds the rate at which data 
packets are output from the DLBR 16. 

In the particular embodiment of FIG. 3, if the communication device 18 inputs data packets or cells to DLBR 16 at 
a rate so great that the token buffer 30 underflows (i.e., so that the number of tokens in the token buffer 30 goes to 
zero), the join circuitry 34 will drop data packets or cells which are lost. As such, the DLBR 16 outputs data packets 
conforming to the parameters of the DLBR 16. As discussed below, the DLBR 16 may be of the type in which, when 



EP 0 873 037 A1 



no tokens are available, the join circuitry 34 can include circuitry that labels data cells as "marked" (non -conforming) 
as low priority data cells. The marked cells are then routed through the network 10 (FIG. 1 ) on a VC but are more likely 
to be dropped if congestion is encountered. 

In this particular embodiment, the shaper 28 receives regulated traffic and, more specifically, date packets con- 

s forming to the parameters of the DLBR 1 6. The particular design of the shaper 28 can be generalized for use with other 
regulators 16, such as multiple leaky bucket regulators, as would be understood by one of ordinary skill in the art with 
the benefit of this disclosure. A regulated data packet is input into the shaper 28 and is stored in a data buffer 42, which 
in this particular embodiment is a FIFO buffer, of size Bug. As in the DLBR 16, if a token is available both in a shaper 
token buffer 44 and on a P s line 46, join circuitry 48 permits the regulated data packet to be output from the data buffer 

to 42 and thus from the shaper 28. As described for the DLBR 1 6, the token buffer 30 in this particular embodiment can 
be implemented as a counter which is clocked at rate r as provided by processing circuitry 36 of the network node 14. 
Thecounter is incremented at the rate rand decremented when a token is used to output a data packet from the shaper 
28. In this particular embodiment, the P s line 46 includes a P s line token buffer 50 which is capable of holding one 
token. The P s line token buffer 38 can also be implemented by a counter which is incremented at the rate P s and 

15 decremented when the token is used to output the data packet from the shaper 28. 

The shaper token buffer 44 is capable of holding Br S tokens. Tokens are supplied to the shaper token buffer 30 
at the rate r carried over from the DLBR 16 in this particular embodiment, and a token is used when a data packet is 
output from the shaper 28. In this particular embodiment, the P s line token buffer 50 receives tokens at the peak rate 
P s , and the Ps line token buffer 50 is capable of holding a single token which is used when a data packet is output 

20 from the shaper 28. As such, the shaper 28 is in general characterized by lour parameters: the mean sustainable rate 
r which in this particular embodiment is carried over from the DLBR 16; Br S is the shaper token buffer size; is the 
data buffer size which stores traffic cells in contrast to the virtual buffering of tokens; and P s is the peak shaper rate 
which in this particular embodiment P s <= P. 

The shaper 28 is designed taking into account the parameters for the DLBR 16. These parameters reflect the class 

25 or quality of service agreed upon between the user and the network service provider. According to certain principles 
of the present invention, the network service provider can exploit differences between the traffic classes, such as 
differences in delay sensitivity, to increase nodal connection capacity by selectively shaping data packets which different 
delay tolerances. Additionally, the service provider can exploit the differences in traffic classes by designing shapers 
28 with different parameters taking into account the different parameters for regulators 16 servicing different traffic 

30 classes. In accordance with certain embodiments of the present invention, the traffic shaping system advantageously 
shapes the traffic using the data buffer 42 at the ingress to the node 14 to reduce the need for buffer memory in the 
multiplexer 20 (FIG. 2) which can be more expensive. In designing the shaper 28 depending on the parameters of the 
DLBR 16, two characteristics for the shaper 28 are considered: 1) the shaper 28 is allowed to introduce a delay which 
cannot exceed the parameter D s and 2) the shaping process is relatively lossless. 

35 In accordance wtth certain principles of the present invention, a exemplary framework is developed below which 

guides in determining parameters for the shaper 28 to increase Ihe nodal connection capacity. The shaping process 
should be lossless for the conforming stream. The non-conforming cell stream does see losses. For the case of de- 
terministic or lossless multiplexing, the sources can be colluding and thus may synchronize their bursts. In the case 
of statistical multiplexing, the sources used in the analysis are asynchronous, non-colluding (independent) sources 

io subject to dual leaky bucket regulation. The independent sources together with the allowance of small (for example, 
on the order of ir> 9 ) loss probabilities makes statistical multiplexing feasible. As mentioned above, the shaper 28 
should be relatively lossless so that losses, if any, occur only at the multiplexer. 

The following framework provides design parameters for the shaper 28 such that a given delay tolerance for the 
connection is satisfied. The exemplary design obtains the admissible region of combinations of sources of various 

45 types such that the quality of service requirements of loss and delay are satisfied and the nodal connection-carrying 
capacity is increased. In this particular framework, the peak rate P s for the shaper 28 is allowed to be a design variable 
gives significant increases in capacity in various typical scenarios. The traffic source model of this framework is de- 
scribed with particular reference to the leaky buck regulator. This exemplary framework focuses on a single network 
node and considers the trading off of bandwidth and buffers and the constraints of regulation and shaping. 

so As background and preliminary facts, basic quantities and operations are provided in the context of the Dual Leaky 

Bucket Regulator (r, Br, P). Traffic streams are modeled as fluid flow. In FIG. 3, Q(t) and R(t) are rate processes; Q(t) 
is offered by the source and R(t) is the conforming process which is passed by the regulator 16. Ao(t, t + 1) and A R (t, 
t+T) denote the total flows during the interval [t, t+i] for the Q and R rate processes, respectively, where rates and total 
flows are generally related thus: 
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AR(t,t + r)= J R(s)ds. 

(I) 

The basic relation describing Ihe conforming process R(t) is 

A R (t, t + x ) = min(A Q {t, t + x), Pt, z(l) + rt) Vt, Vt > 0. (2) 

The "min" operation in (2) is performed by the join circuitry 34. In (2) according to this particular embodiment, z(l) 
represents the token content of the token buffer at time t. The governing equations of z(t) can be shown as. 

d 

— z(t) = r - R(t), ifO<z(t)<B T 
= [r-R(t)]\ ifz(t) = 0 

(3) 

= [r.R(t)]\ ifz(t) = B T 
These equations are used for fluid models with finite buffers. From equations 1 -3, it can be shown that 
R(t) = min(Q(t), P) if z(t) > 0 

(4) 

= min<Q(t), r) if z(t) = 0 . 

The Chernoff large deviations approximation is a technique for estimating loss in bufferless multiplexing systems. 
In this particular embodiment, consider 

P |oss = Pr(U>C), (5) 

where the total instantaneous load 
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are independent, non-negative identically distributed random variables. Here there are J source classes and K,- sources 
of class j. When C is the nodal bandwidth, P toS3 is the fraction of time that losses occur. 

For purposes of this example Iramework, assume that the instantaneous loads u jk have moment generating func- 
tions: 

M J (s)=4^] U=12, ,J). (6) 
and that the stability condition Ey Kj E(u$ < C and that 

otherwise there is no loss. 

In this particular example, Chernoffs bound is 



F(s)=»sC- ZXlogA^(j) (8) 



F(s*) = sup F(s). 

F(s) in this particular embodiment is concave with a maximum at s*(s* > 0), which is obtained by solving F(s) = 0. Also, 
if Kj = 7jC with 7j - O(l) and C -> °°, then 

•°9 P*. = -Rs*) [1 + 0(log C/C)] . (9) 

Hence, the large deviations approximation is ~ exp(-F[s*)). Elementary techniques, such as bisections, are ef- 
fective for calculating s*. 

The above approximation is used for the qualitative treatment in the example framework, but these numerical 
procedures are augmented it by a lower-order refinement described in V. V. Petrov, "On the Probabilities of Large 
Deviationsfor Sums of Independent Random variables," Theory Probab. Applicat. 10, 1965, pp. 287-298. Forthesame 
asymptotic scaling which gives (9), 



where o 2 (s) = log ffe^s 2 . More specifically, 
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m;xs) |m;(j) 



(") 



To improve the Chernoff loss estimate, consider the Chemotl approximation P hss ~ exp(-F(s*)) and distributions 
of independent, nonnegative random variables {u^}, which possess moment generating (unctions and satisfy the fol- 
lowing constraints: for k= 1,2, — , Kjand /= 1, 2, — , J 



In this particular embodiment, e 



iimZ;/ J M;w/M ; (5)>c, 

as otherwise there should be no loss. The result is for any independent random variables u /7k .with distributions V/x; 
which satisfy the constraints (1 2) and (13), there exist on-off random variables u p with distributions ft (x), which take 
values 0 and t/yOnly, and E(u Jk ) = pj, i.e., 

Pr( u jk = u y )=1 -(Pr(<y0)=p j\ (1 4) 

for which the Chernoff approximation to the loss probability is at least as great, i.e., 
F(s*)2:RH 

with equality if Vy^ Vjj- 1 ,2,—, J). 

In order to show a property which is used to obtain the conditions for lossless shaping for this example framework, 
consider FIG. 3 which depicts the coupled system. As shown in FIG. 3, z(t), x(t) and y(t) respectively denote the contents 
of the token buffer 30 in the regulator 1 6, the data buffer 42 in the shaper 28 and the token buffer of the shaper 44 . Define 



»{t)={B 7 - ;(t)} - \x(t) + -y(t)}] 



(15) 



For this particular example, let the data buffer be sufficiently large so that no overflows occur there. In this step, 
the nonnegativity of w(t) is established. 
The governing equations are: 
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d 

— z(t) = r-R(t) ifz(t)<B T (16) 

= [r-R(t)]- ifz(t) = B T 

| f X(t) = R(t)-S(t) (17) 

d 

-y(t)=r-S(t) ifyd)<B T s (18) 
= [r-S(t)]~ ify(t) = BTs. 

To categorize the behavior of w(t) we considgr four regimes: 

Regime (i): z(t) < Bt and y(t) < Br S 
Regime (ii) : z(t) = By and y(t) -Bjq 
Regime (iii): z(t) = Br and y(t) < B^g 
Regime (iv): z(t) < B T and y(t) = 

From (16)-(18), the following is obtained: 

| w(t) = - ^ [z(t) + x(t) - y(t)] = 0, for Regimes (i) and (ii) (19) 

> 0, for Regime (iii) (20) 

£0, for Regime (iv). (21) 

Considering the last relation of the regime (iv), R(t) = Sft) Sr, otherwise the sharker's token buffer 44 would not be 
full. Since, in general, 

y(t) = B ys =>x(t) = 0, (22) 
it also follows that dx/dt =■ 0. Finally, since y(t) = Bj S in Regime (iv), it follows that tfy/dt = 0. Hence, in Regime (iv). 

|[z(t) + x(t>y(t)]= ^ z(t)=r-R(t) > 0 (23) 

and, consequently, dw/dt<, 0. 

The above observations lead to the proposition that if at any time t , w(t ') 2r 0 then for all time f > V, w(t)z0. 

The shaper 43 is under the control of the network management system as processing circuitry 36, and initial 
conditions, i.e., conditions at connection admission can be set. For discussion purposes, assume that at connection 
admission time, say f = 0, w(0) > 0. This can be obtained, for instance, by having the data buffer 42 empty, x(0) = 0, 
and the token buffer 44 full, y(0) = B^. It then follows from the above proposition that: 

w(t)>0 for all />0. (24) 

Consequently, the following, which will be needed later, is true. 
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For t > 0, if x(t)=0 then - y(t)} <.{B T - z(t)}. (25) 

An estimate of how large x(t) can be in the example framework of the system of FIG. 3, where the Dual Leaky 
Bucket Regulator's parameters (r, B T , P) are provided by agreement between user and provider in this example, and 
P s is given in this particular embodiment, where r<P s <P. The maximum of x(t) can assist in determining the size of 
the data buffer 42 in the shaper 28, Bp,, for lossless shaping. 

Let ? 0 be the start of a busy period of the shaper's data buffer 42, i.e. , xftg) = 0 and x(lg¥) > 0. Let A( t, t + x) denote 
the total flow of the rate process R in the interval [t, t + t]. In this example, a bound on A(t, t + x) for all t is E(t): 



Aftc t 0 + r) < E(r) = Tom(PT,zft a ) + rT). (26) 

Two cases are considered, depending upon whether the shaper's token framework buffer 42 has the potential of 
emptying before or after the regulator's token buffer 30 as shown in the grephs of FIG. 4. 

Case,!):™^ (27) 

In this example framework, let F{t) denote a bwer bound on the total flow of the shaped rate process S(t) which 
leaves the shaper's data buffer 42 during the interval [tg, t 0 + tJ. It is assumed here that this interval is contained in the 
busy period of the data buffer 42. Clearly, 



x(t)<x(t)=E(t)-F(t) 

(29) 

In Case (i), 

F(t)=P s t for OSisyfloWP.-r) 

Since x(t<J - 0, and noting that a peak buffer content is reached during the busy period, 

x(i)<z(t 0 )-y(t^io^\\x. 
By the final result of the analysis stated in (25), 

Hence, for Case (i) in this example framework, a bound on the content ol shaper's data buffer 42 is, 
x(t)<B T -B TS . 
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Proceeding to Case (ii), 



again by virtue of x(tg) = 0 and that a peak butter content is attained during the busy period. 
Thus, sufficient conditions for lossless shaping are: 



which respectively arise from Case (i) and Case (ii) as shown in the graph of FIG. 5. 

In determing parameters to satisfy a delay requirement, let D s denote the prespecified bound on the delay intro- 
duced by the shaper 28. The delay in the shaper 2B can be as high as B Dg fr. Hence, the requirement on the maximum 
delay implies the constraint 



The system of inequalities (35)-(36) constitute a set of constraints for the selection of the parameters B TS , B DS 
and Pq, of the shaper 42. All else being equal, smallervaluesof S re and P s leadto higher connection-carrying capacities 
at network nodes. This consideration is the motivation for the solution to the above constraints Thus, given (r, B„ P) 
and the delay bound the selection of (B DS> B TS , P§), which satisfies the delay bound, the constraints due to lossless 
shaping and gives smaller values of Bj S and P s , is obtained by replacing inequalities by equalities, 

B DS = rD s , B T3 = B T - rD s , P $ = P - rD s (P - r>S r (37) 

For discussion purposes, FIG. 6 shows a single source system 52 including shaper 53 in which a single shaped 
traffic stream S(t) feeds a buffer 54 of infinite capacity, which is serviced by a trunk 56 of capacity, i.e., bandwidth, c 
(c> r). The physical multiplexing system is different, which is why the above construct is a "virtual* system. The content 
of the buffer 54 is denoted by v(t). To derive a simple expression for the supremum of the buffer content in this particular 
example, the shaped stream S(t) is such that the total flow in any inlerval [t, t -t x], A s (t, t + 1), is bounded thus 

AJt, t + 1; £ minffyc, y(t) + n)Vt, Vt>0. (38) 

The presence of the token butter content y(t) on the right is on account of the coupling of the shaper 53 with the 
single source system 52, which is necessary to get the following upper bound on the buffer content v(t) in this particular 
example. The presence of other components, such as the shaper"s data buffer, imply additional constraints on v(t), 
which are not used here. 

For all tl 



As such, the supremum of v(Z) occurs during a busy period of the buffer. Let t 0 conespond to the onset of a busy 
period, i.e., vfig) - 0 and v(t 0 + ) > 0. As shown in FIG. 7, during the busy period the total flow into the buffer during the 
interval [fa l 0 - t] is. from (38). bounded by: 

P s t 0<T<y(V?P s -r) (40) 
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On the other hand, since by assumption, the interval [fe, (q + x] is contained in the busy period, the total flow out 
of the buffer is at least cr. The difference, v(x), is. a bound on the buffer content during the butler's busy period. Hence, 
for t>0, 

{ ) - {p s -n - eyo 

As indicated in (39), the bound on the buffer content is given by b, which may conveniently be viewed as a function 
of the variable c, i.e., b = b(c). This function is linear, decreasing. 

For multiplexing several K-shaped traffic streams by a FIFO buffer of capacity B, which is serviced by a trunk of 
capacity, i.e., bandwidth, C. The characteristics of the single source system 52 are used to obtain the capacity of the 
lossless multiplexer, i.e., the maximum number of shaped streams, which may be admitted without any overflow 
of the multiplexer buffer occurring. 

The total flow from the A* shaped stream S^t) in any interval [t, f + x], A^ (f, f + t), is bounded as in (38). The 
aggregate flow si the interval from the superposition of K-shaped streams is bounded by A^ (f, f +- x), where 



A ega {t,t+z)£K min(P s x, B rs + n) - min(KP s x, KB TS + Krt). (42) 

Since the characterization of the aggregate flow is in terms of a single stream with parameters (Kr, KB TS , KPq) 
the same reasoning that was used in (39) can be used to establish a bound on the content of the multiplexing buffer, 
X(t). Assuming initially that the capacity of the multiplexing buffer is infinite, this reasoning gives 

for all /. Hence, if 

-far** ^ 

then there is no loss in the multiplexer with a buffer of size B. 

Using the framework of the above single source system 52 (FIG. 6), K max = L C/fe^J = L B/b 0 J , where (<%, b 0 ) ate 
solutions of the following pair of equations in (c, b), 

(P s -c)B TS 
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Thus, e 0 and may appropriately be called the effective bandwidth and effective buffer, respectively, for a single 
stream. 

In this example framework, the characterization of the capacity of the lossless multiplexing system is the 
admissible number of shaped streams, which are extremal on-off and, furthermore, have coincident on periods. Note, 
if B TS or P s are smaller with all other parameters held fixed, then eg and are smaller and, consequently, the capacity 
is greater. 

Above, an allocation of the two resources for each connection was made which increased the capacity of the 
network node. A key requirement so tar has been that no losses occur in either the shaper 28 (FIG. 3) or the multiplexer 
20 (FIG. 3). This requirement is relaxed now where small losses up to a specified amount L are allowed in the multi- 
plexer. Furthermore, an assumption is made that the connections behave as independent statistical traffic sources, 
which disallows collusive behavior. The combination of the two features allows statistical multiplexing. The resufi of 
statistical multiplexing is increased capacity. 

The key to statistical multiplexing is the observation that, (i) even though each connection is allocated resources, 
say bandwidth % such allocations are not utilized all the time, and, hence, (ii) the probability that several connections 
will require their resource allocations simultaneously decays rapidly with the number of such connections. Relying on 
the Chernoffbound and asymptotic, large deviations approximation to estimate the loss probability, 



where the total bandwidth load 



and u k is the instantaneous random demand on bandwidth from connection k. The random variables {uj are inde- 
pendent, identically distributed. Note that 

0su^e 0 and E(u k )<r (1 Zk<K). (47) 

Using the result in (14), which gives the extremal distribution of independent, identically distributed random vari- 
ables which satisfy (47) and improve the Chemoff approximation to the loss probability. As such, the Chernotf approx- 
imation to the loss probability P tosa in (46) is improved by independent, on-off random variables u k which only take 
values 0 and % and E(u k ) = r, i.e., 

Pr(^=e 0 ) = 1 -Pr(^=0)=<B, (48) 

where «=r/% 

Thus far onty one resource, bandwidth, has been examined. When the worst-case behavior of bandwidth demand 
as expressed in (48) is taken into account in capacity calculations, then the constraints imposed by the other resource, 
buffers, are also accounted for. Note, buffers are utilized only when the bandwidth demand is positive. Specifically, 
when bandwidth demand is 0, then the buffer space demand is 0, and when the bandwidth demand is at its peak value 
of e 0 , then the buffer demand, may be bounded by b 0 (FIG. 7). With this bound, the bandwidth and buffer demand 
processes for each connection are mutually synchronized, on-off, and the loss probability expressed in (46) bounds 
the probability that either bandwidth demand exceeds C or buffer space demand exceeds B in this particular embod- 
iment. 

Since the extremal distribution for the total bandwidth demand U from K connections is binomial, it is straightforward 
to obtain the extremal Chemoff asymptotic approximation for P^. Thus, 



s*o(s*)72n ' 



where 
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C I ^ 
K e 0 e 



W) = /| a log(^ + (l-a)log(^)J , (50) 



a (s)=Kco(1-co) e 0 exp(se o y{1-w+(oexp(se 0 )) . 
The capacity K maj( is the value ol Kkx which 



As such, the quality of service requirement < L is satisfied for all K < K max . The effective bandwidth in the 
context of statistical multiplexing is denoted by e, where eK max = C. Clearly the effective bandwidth for lossless 
multiplexing. 

It requires simple calculus on (50) to establish that F(s') is monotonic increasing with decreasing % for fixed r. 
Together with the prior observation that e$ is monotonic decreasing with decreasing B^g and decreasing Pc;, this shows 
that the design of the shaper 28 (FIG. 3) which increases capacity uses the smaller values of B rs and P $ consistent 
with lossless behavior at the shaper 28 (FIG. 3), and these values are given in (37). 

To extend to the case of multiple classes of connections in the areas of lossless and statistical multiplexing, the 
regulators are specified by (rW, Bf , P(/>), the shaping filters by (A B«, BM,, p<|) and the number of connections by 
Kj for class j. The effective bandwidth and effective buffer of class j sources for lossless multiplexing are obtained as 
described above and denoted by e« and feW , respectively. Thus, the sources K= (K, ,K 2 KJ allow lossless multi- 
plexing if 



(53) 



In showing this, note that from (53) and (45) that 



Considering a virtual partition of the bandwidth into components {Cj} and the buffer into components {&,}, such that 

and 



45 

( 54 > 



14 



EP 0 873 037 A1 



with (Cj,Bj) dedicated to class /sources, note that 

B, C, 

-H- < 55 > 

so that the properties of lossless behavior described above carry over here to each virtually partitioned system dedi- 
cated to all sources of a particular class. 

Let Aq denote the set obtained from the above proposition of admissible sources for lossless multiplexing, i.e., 

M = {K IZ^/^C } . 
Proceeding to statistical multiplexing, the loss probability, is given by the expression in (46), where now 

f - i;x>, 

and u jk is the instantaneous demand on the bandwidth from connection k of class j. The Chemoff asymptotic approx- 
imation is used to estimate P^. The Chemoff asymptotic approximation to the loss probability P loss increases with 
independent on-off random variables u^, which take values 0 and e$ and £(0^) = r</>, i.e., 



where ©0) = jv)/e^>. Assume that 2 K/A < C and 2 y - K ; e|> > C. 

The worst-case Chemoff asymptotic approximation for P loss with statistical multiplexing and heterogeneous sourc- 



1083 s*o(s')J2k' 
where s* is the unique positive real solution to the equation 



\ I - co l,) + a> 0) exp(« 0 u) ) = C ' (58) 



F(s) = sC - 2 K, logjl - a> U) + a> U) exp{se { »)} , (59) 
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Ky>(l - <y 0, )(^") 2 expf^'*) 



{1- 



: X p(5^')} 2 



(60) 



Let A L denote the set of connection K = (K, , .... K) such that P toes as estimated by the expression in (57) does not 
exceed L. For a wide variety of conditions the boundary dA L is closely approximated by an appropriately chosen linear 
'0 hyperplane, which bounds A L in this particular embodiment. An upper bound on A L can be given by {K : Z Kp f £ C\, 
where ej is obtained by considering class / in isolation. When 8A L is close to being linear, this approximation is close 
to the estimate. 

FIGs. 8 and 9 illustrate the results of the shaper design and Ihe role of shaping in increasing the network capacity. 
FIGs. 8 and 9 examine the effect of traffic shaping and the associated traffic delay on the effective bandwidth of the 

'5 traffic sou rces, and demonstrate the advantage of choosing the shaper's parameters in accordance with embodiments 
of the example framework. FIG. 8 depicts the traffic shaping system of FIG. 3 where a single class of sources is subject 
to dual leaky bucket regulation, then shaped and multiplexed on a link with transmission capacity of 45 Mbps and 
(FIFO) buffer size of 1000 cells. The parameters of the dual leaky bucket regulator are: mean rate r= 0. 15 Mbps, peak 
rate P = 1 . 5 Ivfcps and burst size O = 250 cells, where O - BfP/(P - r). The size of the data buffer, B^. of the shaper 

20 28 (FIG. 3)(and hence its delay) is varied from 0 to 225 cells, and the effective bandwidth of the shaped traffic when 
the cell loss probability at the link is not greater than 10" 9 is plotted for the case when the peak rate of the shaper 28 
(FIG. 3), Pg, is equal to the peak rate of the leaky bucket regulator 16 (FIG. 3), P, and for the case when Ps is set to 
the value referred to as P' s in FIGs. 8 and 9. Observe first that increasing the data buffer, BDS, from 0 to 225 cells 
(delay from 0 to 636 msec) has the effect of reducing the effective bandwidth from 0.45 Mbps to the source mean rate 

25 value of 0. 1 5 Mbps, Second, the changing of the peak rate of the shaper 28 (FIG. 3) results in an appreciable reduction 
in the effective bandwidth. FIG. 9 is similar to FIG. 8 except that Ihe parameters of Ihe regulator are r = 0.15 Mbps, P 
= 6.0 Mbps and Q = 25 cells. In this case, varying the peak rate P s ofthe shaper 28 (FIG. 3) does not reduce the 
effective bandwidth as significantly as in FIG. 8. 

FIG. 10 shows the multiplexing of two classes of sources in Hie configuration shown in FIG. 2; class 1 sources are 

so real-time (delay-sensitive), while class 2 sources are non-real time (delay insensitive). The multiplexer parameters are 
B = 1 8000 cells and C = 1 50 Mbps, and therefore introduces a delay of 51 msec, which may be considered to be the 
delay tolerance of class 1 . Since class 2 tolerates greater delay, its traffic is shaped to reduce its effective bandwidth. 
The boundary of the admissible region of class 1 and class 2, sources is plotted for different values of shaping delay, 
Dg, for class 2, ranging from zero to 200 msec. By shaping class 2, the capacity of the system 1 4 (FIG. 2) significantly 

35 increases while meeting the delay constraints of both classes. FIG. 11 shows the admissible region plotted for the two 
class of sources considered separately in FIGs. 8 and 9. Each class is shaped according to a delay constraint and Ihe 
boundary of the admissible region with and without shaping are plotted, illustrating the significant gain in capacity due 
to shaping. 

Thus, according to certain principles and embodiments of the present invention, a framework is provided for inte- 

40 grating shaping on a per-connection basis with FIFO statistical multiplexing. It is shown that differences in delay toler- 
ances between different traffic classes may be exploited by shaping the less delay sensitive traffic. Shaping is shown 
to increase the nodal connection-carrying capacity, with the beneficial increase often quite substantial when a shaper 
design according to generalized versions of the example framework is utilized. 

Alternative embodiments of the framework in accordance with the principles of the present invention are available. 

45 For example, small cell losses could be allowed in the shaper 28 (FIG. 3), so that the total loss has components arising 
from the shaper and the statistical multiplexer. Also, the data buffers from various shapers are designed to share a 
common memory pool. Both features will have the effect of increasing connection-carrying capacity for given total 
memory. Furthermore, the framework according to the principles of the present invention extends readily to switches 
where the buffering is on a per-connection basis and the scheduling is weighted round-robin. 

so In accordance with these and other principles and embodiments of the present invention, FIG. 12 shows an inte- 

grated regulator and shaper 100 used at the ingress to a network node 14(FIG. 1)wheretheregulator16(FIG. 1)and 
shaper 28 (FIG. 1 ) are shown. The integrated regulator/shaper 1 00 concurrently regulates and shapes data cells en- 
tering the regulator and shaper 100. The regulator/shaper 100 of FIG. 12 regulates and shapes separately 1) the 
conforming (unmarked) cells and 2) optionally the aggregate stream of conforming and non-conforming (marked) cells 

$5 admitted into the network 1 0. The integrated regulator/shaper 100 includes a data buffer 1 02 where, using the previous 
parameters discussed, the size of the buffer 1 02 >= B^. The regulator/shaper 100 includes a unmarked token buffer 
104 which is capable of holding Bj S tokens as described for the shaper 28. The unmarked token buffer 104 receives 
tokens at a rate r which is the mean rate for unmarked cells. 
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In this particular embodiment, if the token buffer 104 is full, overflow tokens can be directed to the marked token 
buffer 106. The marked token buffer can hold B" TS tokens, and tokens are fed to the marked token buffer at a rate r*- 
r, where r' is the mean sustainable rate for the aggregate of unmarked and marked data cells. If the marked token 
buffer 106 is full, then overflow tokens are dropped. The token buffers 104 and 106 can be implemented with counters 

s which are incremented at a rate r and r*- r respectively from processing circuitry 1 08 and which are decremented when 
their respective tokens are used to output a data cell from the regulator/shaper 100. 

The regulator/shaper 100 receives an available token on unmarked token line 110 from an unmarked token buffer 
1 1 1 which receives tokens at a rate, Ps, corresponding to the peak rate for unmarked cells. The regulator/shaper 100 
also receives tokens from an aggregate token line 112 from an aggregate token buffer 113 which receives tokens at a 

10 rate, P' s , corresponding to the peak rate of the aggregate (marked and unmarked) cells. In this particular embodiment, 
the unma rked token buffer 1 11 is capable of holding one token , and the aggregate token buffer 1 1 3 is capable of holding 
one token. The token buffers 111 and 113 can be implemented by counters which are incremented at the rates of P s 
and P s ' respectively and which are decremented when their respective tokens are used to output a data cell from the 
regulator/shaper 100. As such, the regulator/shaper 100 is in general characterized by various parameters: the mean 

15 sustainable rate r for unmarked cells; the mean sustainable rate r' for the aggregate stream of cells whose default 
value is r; Bj$ is the unmarked token buffer size; B' T s '« the unmarked token buffer size; BD is the data buffer size 
which in this particular embodiment >= B^tor the shaper 28 (FIG. 3); Ps is the peak rate for unmarked cells; and P' s 
is the peak rate for the aggregate stream of cells where in this particular embodiment P s <= P' s . 

In this particular embodiment, every data cells that arrives at the regulator/shaper 100 with BDs unmarked cells 

20 already in the buffer 102 (which is a FIFO buffer in this particular embodiment) is marked by processing circuitry 108. 
In this particular embodiment, the processing circuitry 108 can mark a cell by setting a particular priority bit in the data 
cell, and once the data cell is marked, the cell remains marked. For example, in conventional ATM data packets, the 
processing circuitry 108 can set a CLP bit to 1 for marked (non-conforming) cells. When an unmarked cell gets to the 
head of the FIFO buffer 1 02 in this particular embodiment, the unmarked cell warts for available tokens in the unmarked 

25 token buffer 104, the unmarked peak rate line 110 and the aggregate peak rate line 112. If a token is available in all 
three in this particular embodiment, the tokens are used up, and join circuitry 120 permits the unmarked data cell to 
be output from the data buffer 42 and thus from the regulator/shaper 100. 

When a marked cell arrives at the head of the buffer 102 in this particular embodiment, the marked cell needs 
available tokens in both the marked token buffer 106 and the aggregate peak rate line 112 for the join circuitry 120 to 

so permit the output ol the marked ceil from the regulator/shaper 100. The marked cell in this particular embodiment does 
not wait for tokens. Upon the arrival of the marked cell, if either the marked token buffer 106 or the aggregate peak 
rate line 112 does not have an available token, the marked cell is dropped or tost. In accordance with certain aspects 
of this particular embodiment, if the unmarked cells are using less than the token rate r and the unmarked token buffer 
104 is full, overflow tokens will flow into the marked token buffer 106. As such, the difference between r' and r as well 

35 as any unused portions of r is used by the marked cells. 

In accordance with alternative embodiments according to the principles of the present invention, if P s ' is made 
equal to P s the unmarked peak rate line 1 1 0 and any corresponding buffer 1 1 1 can be removed from the design of the 
regulator/shaper 100. If the aggregate output stream of data cells S' is not subject to mean rate regulation i.e., r" = «>, 
then the marked token buffer 106 and corresponding line can be removed from the design of the regulator/shaper 100 

40 with some change in the logic of the join circuitry. If both the P s ' = P and the mean rate regulation is removed from the 
aggregate stream of data cells, the regulator/shaper can be reduced to the design of FIG. 13. 

FIG. 13 shows a regulator/shaper 122 receiving an aggregate stream Q of conforming and non-conforming data 
cells into a data buffer 124 shown with unlimited size. In this particular embodiment, the token buffer 126 receives 
tokens at the mean token rate r and the aggregate peak rate line 128 provides tokens for the aggregate (conforming 

4S and non-conforming) data cells from a aggregate peak token buffer 1 30 which holds one token and receives tokens 
at a rate P s . In this particular embodiment, an arriving data cell is marked by processing circuitry 131 if Bq S unmarked 
cells are in the data buffer 1 24. An unmarked data cell is output from the regulator/shaper 1 22 by the join circuitry 1 32 
if a token is available on the aggregate peak line 1 28. If not, the unmarked data cell waits for the tokens. Upon arrival 
to the head of the data buffer 124, a marked cell is output from the regulator/shaper 122 by the join circuitry 132 if a 

so token is available in both the token buffer 1 26 and the aggregate peak line 1 28. If not, the marked token is dropped or 
lost. 

Alternative configurations of the traffic shaping system are possible which omit or add components, use different 
parameters, use different criteria for marking data cells and/or perform variations of the above-described control 
scheme. For example, the traffic shaping system embodiment of FIG. 13 can use a variation of the control scheme by 
55 outputting unmarked data cells from the regulator/shaper 122 when tokens are present on both the token buffer 126 
and on the aggregate peak line 128. Alternatively, marked cells may be permitted to wait for tokens if no unmarked 
cells are in the data buffer 1 24. Other alternatives can be used which are encompassed by the principles of the present 
invention to increase nodal capacity by regulating and shaping data cells at the ingress to the node. Furthermore, the 
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principles of the traffic shaping system can be used to shape data cells at the egress of the node. 

Additionally, the traffic shaping system has been described as being comprised several simple components, such 
as a dual leaky bucket regulator, but it should be understood that the traffic shaping and portions thereof can be em- 
ployed using other forms of regulators and shapers, application specific integrated circuits, software driven processing 
circuitry, or otherarrangements of discrete components. What has been described is merely illustrative of the application 
of the principles of the present invention. Those skilled in the art will readily recognize that these and various other 
modifications, arrangements and methods can be made lo the present invention without strictly following the exemplary 
applications illustrated and described herein and without departing from the spirit and scope of the present invention. 



Claims 

1. A traffic shaping system for a network node CHARACTERIZED BY said traffic shaping system being node con- 
figured to receive data cells and to shape said data cells to increase the admissible number of connections for 
said network node for increasing the capacity of said network node. 

2. The traffic shaping system of claim 1 CHARACTERIZED BY a data buffer at the ingress of the network node to 
selectively buffer classes of data cells. 

3. The traffic shaping system of claim 2 CHARACTERIZED IN THAT said traffic shaping system exploits differences 
in delay tolerances between traffic classes to selectively shape the less delay sensitive traffic classes. 

4. A method of increasing the connection capacity of a network node CHARACTERIZED BY the steps of: 

selecting parameters for a traffic shaping system taking into account regulation parameters to increase the 
connection-carrying capacity for the node while meeting quality of service requirements for the traffic cells. 

5. The method of claim 4 CHARACTERIZED IN THAT said step of selecting further includes the step of: 

selecting a peak rate for the traffic shaping system. 

6. An integrated regulator and shaper for a network node CHARACTERIZE D BY said integrated regulator and shaper 
being configured to concurrently regulate and shape traffic cells to increase the connection-carrying capacity of 
said network node. 
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FIG. 4A 
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FIG. 10 
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